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We consider the infinite-range spin glass in which the spins have m > 1 components (a vector spin 
glass). Applying a magnetic field which is random in direction, there is an Almeida Thouless (AT) 
line below which the "replica symmetric" solution is unstable, just as for the Ising (m = 1) case. 
We calculate the location of this AT line for Gaussian random fields for arbitrary m, and verify our 
results by numerical simulations for m = 3. 
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I. INTRODUCTION 

The infinite-range Ising spin glass, first proposed by 
Sherrington and KirkpatrickA, has been extensively stud- 
ied. It was found by de Almeida and Thouless^ (hereafter 
referred to as AT) that the simple "replica symmetric" 
(RS) ansatz for the spin glass state becomes unstable be- 
low a line in the magnetic field-temperature plane, known 
as the AT line. While the Ising spin has m = 1 compo- 
nents, the m-component vector spin glass for m > 1 has 
received less attention, de Almeida et al4 (hereafter re- 
ferred to as AJKT) found an instability in zero field, but 
did not consider the effects of a magnetic field. The ef- 
fects of a uniform field on a vector spin glass were first 
studied by Gabay and Toulouse 4 . They found a line of 
transitions (the GT line), which is of a different nature 
from the AT line. In a uniform field, a distinction has 
to be made between spin components longitudinal and 
transverse to the field, and the GT line is the spin glass 
ordering of the transverse components, and these are ef- 
fectively in zero field£&. The AT line is different from 
the Gabay- Toulouse 4 - (GT) line, since it is a transition 
to a phase with replica symmetry breaking but with no 
change in spin symmetry. The existence of the AT line 
is perhaps the most striking prediction of the mean field 
theory of spin glasses. The GT line occurs at a higher 
temperature than the putative AT line, which becomes 
simply a crossover^. 

The main point of the present work is to argue that 
one should consider not a uniform field but a field which 
is random in direction (it will also be convenient to make 
it random in magnitude though this is not essential) and 
that, in this case, there is an AT line also for vector spin 
glasses. We will determine the location of this line for an 
arbitrary number of spin components. 

The Hamiltonian is given by 



(hi) « 



(1) 



where the , (fi = 1, • • • , m) are m-component spins of 
length m 1 / 2 , i.e. 



(2) 



the interactions Jij between all distinct pairs of spins 
are independent random variables with zero mean 
and variance given by 
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and the /if are independent Gaussian random fields, un- 
corrected between sites, with zero mean and which sat- 
isfy 



(4) 



The notation [■ • • ] av indicates an average over the 
quenched disorder. The normalization of the spins in 
Eq. ([2]) is chosen so that the zero field transition temper- 
ature is 



T C = J 



(5) 



for all m. 

Consider first the Ising case (m =1). The spin glass 
order parameter is 
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where (• • • ) denotes a thermal average. From linear 
response theory, if we make small additional random 
changes, Shi, in the random fields, uncorrelated with each 
other and the original values of the fields, the change in 
(Si) is given by 
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where the linear response function x%j is given by 

Xij = (SiSj) - (SiXSj) , (8) 

and, for convenience, we have separated out the factor of 
1/T. Hence the change in q is given by 
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where 



Xsg 



-(SiXSj) f 



(ii) 



is the spin glass susceptibility. 

The corresponding results for vector spins are easily 
obtained. The change in the spin glass order parameter, 



(12) 



is given by 

§ * = fsjj E ~ E [xfx^] av [^^] a v, (13) 
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where now 
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For the Ising case, the sign of the field can be "gauged 
away" by the transformation Si — > —Si, and — > — Jy 
for all j. Hence the only difference between a uniform 
field and a Gaussian random field is that the latter varies 
in magnitude, and these magnitude fluctuations turn out 
to have only a minor effect. However, for the vector 
case, the random direction of the Gaussian random field 
does make a big difference because there is no longer a 
distinction between longitudinal and transverse, and so 
there is no longer a GT line to preempt the AT line. 

In zero field, \SG diverges at the transition tempera- 
ture T c given in Eq. ([5]), which is expected since xsg is 
the susceptibility corresponding to the order parameter. 
Surprisingly, AT showed for the Ising case (m = 1) that it 
also diverges in a magnetic field (either uniform, as origi- 
nally considered by AT, or random, as considered later by 
Bray-) along the AT line in the field-temperature plane. 
Below the AT line, xsg goes negative, indicating that 
the RS solution is incorrect, and has to be replaced by 
the Parisi^ replica symmetry breaking (RSB) solution. 

In this paper we calculate xsg for a vector spin glass 
in the presence of a random field, and show that it also 
becomes negative below an AT line in the h r -T plane, 
whose location we calculate. This fact does not appear 
to be widely recognized. Although a field which is ran- 
dom in direction can presumably not be applied experi- 
mentally, we feel that there is theoretical interest in our 
result because a random field can be applied in simula- 
tions. Whether or not an AT line exists in finite-range 



spin glasses, is a crucial difference between the replica 
symmetry breaking (RSB) picture^— of the spin glass 
state, where it does occur, and the droplet picture^—, 
where it does not. It has been found possible to simulate 
Heisenberg spin glasses for significantly larger sizesiSr— 
than Ising spin glasses, so our results may give an addi- 
tional avenue through which to investigate numerically 
the nature of the spin glass state. 

The plan of this paper is as follows. In Sec. [TT] we 
compute the non-linear susceptibility for the Ising spin 
glass following the the lines of AT. In Sec. IIIII we do the 
corresponding calculation for the vector spin glass. This 
is followed in Sec. IIVI by a numerical evaluation of the 
AT line for several values of m and a confirmation of the 
results by Monte Carlo simulations for the Heisenberg 
spin glass, m — 3. We summarize our results in Sec. [V] 
Many of the technical details are relegated to appendices. 



II. THE SPIN GLASS SUSCEPTIBILITY FOR 
ISING SPIN GLASSES 

In this section we review the calculation of the AT line 
for the Ising case. In the next section we shall use this 
approach to derive the AT line for vector spin glasses. 

The standard way of averaging in random systems is 
the replica trick, which exploits the result 



In Z = lim 
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Applying this to the Ising (m = 1) version of the Hamil- 
tonian in Eq. ([T]), one has 
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We denote averages over the effective replica Hamilto- 
nian in the exponential on the RHS of Eq. ([TBI by (•■■). 
Following standard steps, see e.g. Refs. Hlll9l. one obtains 
(omitting an unimportant overall constant) 
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where L[q a p] is given by 
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(19) 



(20) 



the trace is over the spins S a , a — 1, • • • , n, and (a/3) 
denotes one of the n(n — l)/2 distinct pairs of replicas. 
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We take the replica symmetric (RS) saddle point, 
where all the q a p are equal to the same value q. The 
spin traces at the RS saddle point are evaluated by writ- 
ing 



Tre L = Tr exp(/3 2 £ (J 2 q + h 2 ) S a S? 



Trexp ^ (A + A?) ({£*"}' 
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where, in the last line, we omitted the constant factor 
cxp[— {(3 2 /2){J 2 q + h 2 )n], and decoupled the square in 
the exponential using the identity 
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e -z 2 /2 + az dz = e a 2 /2 



(22) 



Consequently the replica spins S a (without site label) 
are independent of each other and feel a Gaussian ran- 
dom field (the same for all replicas) with zero mean and 
variance given by 

A 2 = f3 2 (J 2 q + h 2 ) . (23) 

We denote an average over the Gaussian random variable 
z in Eq. pi) by [•••]«. i.e. 



[mi 



i 



V2^ J- 



-z 2 /2 



f(z)dz. 



(24) 



It is straightforward to evaluate averages over the S a , 
since they are independent, so we will now express aver- 
ages over the real spins Si in terms of S a averages. 

One can show, see e.g. Ref.[l9l that each separate ther- 
mal average corresponds to a distinct replica, so, for ex- 
ample, 



[(s i s J )(s k )(s l )] m = (s?s?sjlS7) 



(25) 



for a, (3 and 7 all different. To evaluate averages of the 
form in the RHS of Eq. ([23)1 we add fictitious fields A Q ^ 
which couple the replicas 19 , so Eq. (|T8)) becomes 
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Taking derivatives with respect to A Q( g, one has, for n — » 
0, 
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Now setting the A Q ^ to zero we get, from Eq. (|26|) . in 
the n — > limit, 



q EE l[(^) 2 ] av = 1 £<S?S?) = [{S a S% , 



(28) 



for a 7^ (3. We emphasize that, in the final average [(...)] z , 
the inner brackets refer to averaging over the spins in a 
fixed value of the random field z in Eq. (|2"Tj) . and the 
outer brackets, [• • -] z , refer to averaging over z accord- 
ing to Eq. (|24l) . Equation (|28|) leads to the well-known 
self-consistent expression 1 ' 19 for the spin glass order pa- 
rameter q: 

q={(S a SP)] z , 



= [tanh 2 [/3 (J 2 q + h 2 r ) 1/2 , 
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It will be useful to express the average in Eq. (|27a[) 
in a different way. Including the fictitious fields A Q( 3 in 
the derivation which led from Eq. (TT51) to Eqs. p^|) and 
(l20l) one finds an extra term, A a pS a SP , in L[g Q/ 3]. 

Defining new integration variables byi 9 - 



q a p + (J3J) 2 A al 3-^-q a p. 



(30) 



then A a /3 no longer appears in L, only in the quadratic 
term in Eq. (fl~9|) . Using Eqs. ([27|l . one then gets 

5 = ^E< 5 ^f> = <<M}, (31a) 

i ^{SfSfSjSt) = N(q aP q lS ) - (/3J)- 2 5 M ), (75 ) . 



(31b) 



Hence the spin glass susceptibility, defined in Eq. (fTTj) , is 
given b y 19 ' 20 

XSG = N ((Sqlp) - 2(Sq a/ 3 5q aj ) + (Sq a p 5q lS ))-(f3jy 2 , 

(32) 

where all replicas arc different, and Sq a p is defined by 



q a f3 = q + 5q a/ 3. 



(33) 



We now expand Eq. ([19) about the saddle point to 
quadratic order in the 5q a p . The result is that the expo- 
nential in Eq. (|T9") becomes 



exp 



(-Nf(q) 



-N 



where f{q) is the value of the exponent at the sad- 
dle point. To obtain the elements of the |n(n — 1) by 
|n(n — 1) matrix A we take the log of Eq. (|19|) and write 
the coefficients in the expansion of In Tr e L in powers of 
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the 8q a p in terms of spin averages, evaluated by the de- 
coupling in Eq. (f2"T|) . The result is 

A"/3),(7<5) = <W)( 7 5)- 

((3jf { [{S a S ff S^S 5 )] z - [(S a S?)] [(S^S S )]J . (35) 



Equation (|34[) is the weight function used for averaging 
over the Sq a /3 in Eq. (1321) . Performing these Gaussian 
integrals gives 
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where G is the matrix inverse of A, i.e. 

G A = I 

where / is the identity matrix. Defining 
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we have 



where 
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(40) 



is called the "replicon propagator"—. 

The matrix inverse of A is evaluated in Appendix IA4I 
According to Eq. (|A22|) we can express Eq. ([39| as 



where 
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A, 
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P-2Q + R, 



(41) 



(42) 



and the quantities P, Q and R arc defined in Eq. (|A2[) . 
The eigenvalues of A are evaluated in Appendices IA IT 
A 3[ and it turns out that A3 is an eigenvalue of A, see 
Eq. (|A17|) . We evaluate the relevant spin averages needed 
to determine A3 in in Appendix [DJ and Eq. (|C22p gives 



A 3 = 1 - (f3J) 2 x° SG , 
or equivalently, from Eq. (|41[) . 
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X°SG 
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where Xsg ^ s a single-site spin glass susceptibility, given 
for the Ising case by 



X°SG 



((SS)-(S)(S) 

(l-<s> 2 ) 2 , 

J z 

(l -tanh 2 [^(j 2 g + /i2) 1/2 z ] 
= 1 - 2q + r, 
where q is given by Eq. (|29[) and r is given by 
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(45) 



e~ z I 2 tanh 4 [(3 (J 2 q + h 2 r ) 1 z] dz . (46) 



Hence, according to the RS ansatz, xsg is predicted to 
diverge where 



(PJYxsg = 1, 



(47) 



which describes the location of the AT line. In particular, 
for small fields the AT line is given by 



4 (T c — T 



(m = 1) : 



(48) 



see Eq. (|C34[) . In fact, xsg turns out to be negative 
below this line since A3 is negative in this region, see 
Eq. (jC33"l) . These results were first found by AT. At low 
temperatures we get 



h r (T -> 0) 
J 



J 
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(49) 



see Eq. (|C37[) , in agreement with Brayi A plot of the AT 
line for m = 1, obtained numerically, is shown in Fig. [TJ 
Although the derivation of Eq. (|44|) is rather involved, 
we note that the final answer is quite simple and has 
a familiar mean field form, i.e. a response function \ is 
equal to Xo/(l — Kxo) where xo is the non-interacting 
response function, and K (= (/3 J) 2 here), is a coupling 
constant. In the next section, we will see that \sg has 
precisely the same mean field form for the vector (to > 1) 
case. 



III. THE SPIN GLASS SUSCEPTIBILITY FOR 
VECTOR SPIN GLASSES 

Here we consider a vector spin glass in which the Ising 
spins are replaced by vector spins with m components. 
The fluctuations in zero field were first considered by 
AJKT and Ref. [13 and our approach follows closely that 
of the latter reference. However, we shall see that there 
are some differences between our results and those of 
AJKT and Ref. 22. The derivation follows the lines of 
that for the Ising case in the previous section, but with 



5 



the burden of additional indices for the spin components. 
Hence we will not go through the details but just indicate 
the main steps and the results. 

To avoid confusion in notation, we will use the Greek 
letters a, f), 7, 6, e for replicas and /j,,v,k,<j for spin in- 
dices. The auxiliary variables q will now involve 4 indices 
(a0),fiv, in which the order of the replica pair (a/3) is 
unimportant, i.e. (/3a) is the same as (a/3), but the order 
of the spin indices does matter because S£Sg is not the 



same as S^S^. Another new feature which appears when 
we deal with vector spins is the appearance of terms with 
both replicas equal, (aa). These do not appear for the 
Ising case because (S a ) 2 is equal to 1, a constant. How- 
ever, (S^) 2 is not a constant for m > 1 and so we now 
need to include (aa) terms in the analysis, though they 
will not enter the final result for xsg- 

The analogues of Eqs. (|T9)) and (|20)) are 



[* n w = r ( n (^) 1/2 ( n (U) 1/2 (w< 

xexp(-A^{ £ ( 5 |5) > +i;(e , })(^BpI^«l) , ' 1 (50) 



where is given by 



where we ignored a term i(/3/i r ) 2 Q (Sff) since it is We then have, ignoring overall constant factors, 
a constant. 

We take the replica symmetric (RS) saddle point, 
where 

<?afi = 1 <W> Qaa = x <W • (52) 



e £ (x Tr exp(/3 2 E ( A + h r) ^) = ^ e *P (y ( A + £({ E 

n 

Y[ [Tre /3(j2,?+ ' l " )1/2 ^^ z " S ° 



(53) 



where, to get the last line, we decoupled the square in by [• ••]„. 

the exponent using Eq. (I2"2j) . As for the Ising case, we Proceeding as in Sec. |TT1 the spin glass susceptibility, 
denote an average over the Gaussian random variables z M defined in Eq. (1161) , is given by 



= ^ ( E W V) - V) + (K$ h7s) ) - w 2 , (54) 



(with a, /3, 7 and 5 all different) where the averages over the 5q are with respect to the following Gaussian weight 
(analogous to that in Eq. for the Ising case), 



PTn | y (^) 2 f \^ 7 UV,KO X„V" X„KO , 7 uv,ko t r KCT , yU.V,Ka ^Qaa ^77 "I I /rr\ 

P 2l ^ Z (a/3),( 7 '5)' ) ^ d9 7<5 + Z ( Q a),( 7 <5) ~/T + 2^ Z (aa) , (77) ~7^~ / ' t 55 ' 

V (a/3), ( 7< 5) a,( 7 «) V ^ a,T \ - \ - / 
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and 



(/3J) 2 {[{S^S2S s a )] z -[{S^)] [{S2S 5 a )] z }. (56) 

Note that the annoying factors of l/\/2 and 1/2 in 
Eq. (|55p can be removed simply by incorporating a fac- 
tor of l/\/2 into the q^ a . Doing the averages in Eq. 
using the Gaussian weight in Eq. (1551) gives 



XSG 



J) 2 Xm^l 



ZLT (a/3),(a 7 )' 



U (a/3),(7<5) 



1 



}, (57) 



where G = Z 1 . Using the dehnitions in Eqs. (|B32[) . we 
have 



XSG = 



(G r - 1) 



(58) 



where the "replicon" propagator is given by 



G r = Gil + (m - l)G 1T - 2 [G 2L + (m - 1)G 2T ] + 

G 3L + (to - 1)G 3T ■ (59) 



The matrix inverse of Z is evaluated in Appendix IB 5 
According to Eq. (|B35I) , we can express Eq. (|58|) as 



XSG 



- 1 



(60) 



where 



A 3 s = Pl + (to - 1)P T -2[Q L + (m- l)Q T ] + 

R L + (m-l)R T . (61) 



We determine the eigenvalues of Z in Appendices IB II 
B 31 and show that A35 is an eigenvalue, 

From Eq. (IC22I) . we see that Eq. (|5"8")l can be written 
in the same form as for the Ising case, Eq. (PHI) , where, 
for the case of general to, the single-site spin glass sus- 
ceptibility x'sg * s evaluated in Appendix [C] and given by 
Eq. (IC241) . 

The AT line is where {PJfxsc = L Near T c this is 
given by 



t 3 , 



(62) 



see Eq. (|C34|) . The same expression was obtained by 
Gabay and Toulouse^ but for a uniform held, in which 
case it refers to a crossover rather than a sharp transition. 
Note that h r = for m = 00, as expected since AJKT 
showed that the replica symmetic solution is stable in 
this limit. In the opposite limit, T —¥ 0, we find that the 
value of the AT held is hnite for to > 2, 



h r (T = 0) 
J 



y/rn 



(to > 2) , 



(63) 



see Eq. (fC36|) . while h r (T -s- 0) diverges for to < 2. The 
location of the AT line, obtained numerically, is plotted 
in Fig. [T]for several values of m. 

Below the AT line, \SG is predicted to be negative, 
see Eq. (|C33I) . which is impossible and shows that the 
RS solution (which we have assumed) is wrong in this 
region. 

For h r = 0, Eq. (IC331) gives A 3S = -At 2 /{m,+2), which 
disagrees with the unstable eigenvalue — 8t 2 /(m + 2) 2 
given by AJKT and Ref. [22|. However, we note that the 
replicon propagator in Eq. (|59"|) corresponds precisely to 
Eq. (3.5) of Ref. [H and Eq. ([52]) also appears in the 
paper by Gabay and Toulouse^, so we are confident that 
Eq. (|G33[) is correct. Note too that we obtained the spin 
glass susceptibility, the divergence of which indicates the 
AT line, directly from the inverse of the matrix Z , the cal- 
culation of which is fairly simple, see Appendix IB 51 The 
extra information that \SG is related to an eigenvalue, 
A3S, is not strictly needed to locate the AT line. 



IV. NUMERICAL RESULTS 

We have determined the location of the AT line nu- 
merically for to = 1,3 and 10. For a given T and as- 
sumed value of h r we solve for q self-consistently from 
Eq. (|CT8)) and substitute into Eq. ((U24)) which gives A3S 
from Eq. (|C22[) . The value of h r is then adjusted un- 
til A3S = 0. The results are shown by the solid lines in 
Fig. [TJ Also shown, by the dashed lines, is the approxi- 
mate form in Eq. (f6"2"| which is valid close to the zero field 
transition temperature. For to = 3 this approximation 
actually works well down to rather low temperatures. 

If the spins are normalized to have length 1 rather than 
to 1 / 2 one divides the horizontal scale in Fig. [T]by m and 
the vertical scale by 1/to 1 / 2 , so the zero field transition 
temperature would be T c — J/m and the zero tempera- 
ture limit of the AT field would be h r = J / \Jm{m — 2), 
for m > 2 (compare with Eq. 

We have also checked these results by Monte Carlo sim- 
ulations for the Heisenberg case, to = 3. The method has 
been discussed elsewher o 16 i 18 , so here we just give a few 
salient features. We use three types of moves: heatbath, 
overrelaxation, and parallel temperin g 24 ' 25 . We perform 
one heatbath sweep and one parallel tempering sweep for 
every ten overrelaxation sweeps. The parameters of the 
simulations are given in Table HI In calculating the spin 
glass susceptibility in Eq. (TTBl . each thermal average is 
run in a separate copy of the system to avoid bias. Hence 
we simulate four copies at each temperature. 

When the quenched random disorder variables are 
Gaussian, as here, the following identity is easily shown 
to hold by integrating by parts the expression for the av- 
erage energy U with respect to the disorder variable s 16 ' 26 , 



U 



m)} 



2T 
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q), (64) 
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TABLE I: Parameters of the simulations for different values 
of hr. Here -/V samp is the number of samples, N sweep is the 
number of overrelaxation Monte Carlo sweeps, T m i n and T max 
are the lowest and highest temperatures simulated, and Nt 
is the number of temperatures. 



h r 


N 


samp 


N sweep 




Tin ax 


N T 





64 


8000 


256 


0.30 


1.50 


40 





128 


8000 


512 


0.30 


1.50 


40 





256 


8000 


1024 


0.30 


1.50 


40 





512 


8000 


2048 


0.30 


1.50 


40 





1024 


2078 


4096 


0.30 


1.50 


40 


0.173 


64 


8000 


1024 


0.30 


1.50 


40 


0.173 


128 


8000 


2048 


0.30 


1.50 


40 


0.173 


256 


8000 


4096 


0.30 


1.50 


40 


0.173 


512 


4279 


8192 


0.30 


1.50 


40 


0.173 


1024 


1494 


16384 


0.39 


1.50 


40 


0.346 


64 


8000 


1024 


0.15 


1.20 


40 


0.346 


128 


8000 


2048 


0.15 


1.20 


40 


0.346 


256 


8000 


4096 


0.15 


1.20 


40 


0.346 


512 


4293 


8192 


0.15 


1.20 


40 


0.346 


1024 


3037 


16384 


0.15 


1.20 


40 



FIG. 1: The solid lines indicate the location of the AT line 
for m = 1,3 and 10, according to Eq. I|7ip. and Xsg given 
by Eq. (|C24|) . For m — > oo the AT line collapses on to the 
horizontal axis. The dashed lines are the approximate form 
given in Eq. (|62l) . which is valid close to T — T c = J. Note 
that this approximation works remarkably well for the Heisen- 
berg case, m = 3, even down to quite low temperatures. Also 
shown are Monte Carlo results for the critical temperature for 
h r = 0, 0.173 and 0.346 for m = 3. 



where 



7 - -hX (s '- s ' 



(65) 
(66) 
(67) 



in which q is the expectation value of the spin glass order 
parameter, and qi is called the "link" overlap. 

While Eq. (|64p is true in equilibrium, is not true be- 
fore equilibrium is reached, and, indeed, the two sides 
of the equation approach the equilibrium value from op- 
posite direction o 16 i 26 . Hence we only accept the results 
of a simulation if Eq. (|64|) is satisfied with small error 
bars. (Note that this equation refers to an average over 
samples; the connection between the energy and the spin 
correlations is not true sample by sample.) 

According to finite-size scaling the spin glass suscep- 
tibility in a finite, infinite-range system, should vary 



„27-30 



XSG 



N l '*X (N 1/3 (T - T c (h r )fj 



(68) 



so plots of xsg/N 1 / 3 should intersect at the transition 
temperature T c (h r ). Data for xsg/N 1 ^ 3 for m — 3 for 
random field values h r = 0, 0.173 and 0.346, are shown in 
Figs ■ HIGH and HI The data does indeed intersect, indicat- 
ing a transition, though the data for different sizes don't 
intersect at exactly the same temperature which indicates 
the presence of corrections to finite-size scaling. 

There are both singular and analytic corrections to 
scaling. In the mean field limit the leading correction to 
XSG is analytic*^, in fact just a constant, so we replace 
Eq. P]) by 



XSG = N^X (V/ 3 (T - T c {hr))) + 



co- 



rn 



We compute the intersection temperature T*(N, 2N) be- 
tween data for Xsg/N 1 / 3 for sizes N and 2N . It is then 
easy to see from Eq. (fBU)) that the T*(N,2N) converge 
to the transition temperature like 



T*(N, 2N)-T c (h r ) 



A 



AT2/3 



(70) 



where the constant A is related to Co and X'(0). We 
determine T*(N,2N) by a bootstrap analysis and show 
the results both in Table [TT1 and in the insets to Figs.[2J[3] 
and|4j Fitting a straight line through T*(N,2N) against 
N~ 2 /' 3 according to Eq. ([70]) . gives estimates of T c which 
shown both in Fig. [1] and Tabic [TT1 

We see that, in zero field, the numerics accurately gives 
the exact value for T c of 1, and for non-zero h r , the 
numerics gives the correct answer to within about one 
sigma. Hence our analytical predictions for the AT line 
in Heisenberg spin glasses are well confirmed by simula- 
tions. 
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i I i i i i I i i i i I i i i i I i i i i I i i i i 



0.8 0.9 1 1.1 1.2 
T/J 

FIG. 2: Zero field Monte Carlo data for the spin glass suscep- 
tibility for the m — 3 (Heisenberg) infinite-range spin glass, 
divided by N 1 ^ 3 , for different sizes. According to finite-size 
scaling, the data should intersect at the transition tempera- 
ture T c in the absence of corrections to scaling. Allowing for 
the leading corrections, the inset shows intersection temper- 
atures T*(N, 2N) for sizes N and 2N and the extrapolation 
to N = oo according to Eq. (|70|) . This leads to the estimate 
T c = 0.9987 ± 0.0036 (see Table EJ, which agrees well with 
the exact value of 1, shown as the dashed line in the inset. 



TABLE II: Intersection temperatures T*(N, 2N), and extrap- 
olated values of T c (h r ) determined from fits to Eq. (|70p . Also 
shown is the exact value for T c (h r ), obtained as described in 
the text. 



K N 


T*(N,2N) 


T c (h r ) 


T c (h r ) (exact) 


64 
128 
256 
512 


0.9478(61) 
0.9709(32) 
0.9832(22) 
0.9837(29) 






oo 




0.9987(36) 


1 


0.173 64 
0.173 128 
0.173 256 
0.173 512 


0.633(13) 
0.634(13) 
0.668(15) 
0.680(18) 






0.173 oo 




0.679(19) 


0.6652 


0.346 64 
0.346 128 
0.346 256 
0.346 512 


0.473(19) 
0.447(29) 
0.485(19) 
0.498(21) 






0.346 oo 




0.497(23) 


0.4706 




FIG. 3: Same as Fig. [2] but for random field strength h r = 
0.173. The final estimate of T c (h r ) is 0.685 ± 0.019 which is 
to be compared with the exact value of 0.6652, see Table ITT1 
which is shown as the dashed line in the inset. 



-•-1024 




J I I I I I I I I I I I I I I I I ] I I I I I I I L_ 

0.3 0.4 0.5 0.6 0.7 0.8 

T/J 



FIG. 4: Same as Fig. [2] but for random field strength h r = 
0.346. The final estimate of T c (h r ) is 0.497 ± 0.023, to be 
compared with the exact value of 0.4706, see Table HT1 which 
is shown as the dashed line in the inset. 
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V. CONCLUSIONS 

We have emphasized that the appropriate symmetry 
breaking field for a spin glass is a random field, and 
that, for a vector spin glass, the crucial ingredient is the 
random direction of the field. Incorporating a random 
field, there is a line of transitions (AT line) in vector spin 
glasses, just as there is in the Ising spin glass, a fact which 
does not seem to be widely recognized. The AT line is 
different from the Gabay- Toulouse^ (GT) line, since it is 
a transition to a phase with replica symmetry breaking 
but no change in spin symmetry. 

The location of the AT line for vector spin glasses with 
Gaussian random fields is given by 

(j) =X°sg, (71) 

where x'sg ^ s gi ven by Eq. ()C24|) . For the important 
case of the Heisenberg (m = 3) spin glass, the simpler 
expression for Xsg * s gi yen m Eq. (|C26|) . We have plotted 
the AT line numerically for several values of m in Fig. [TJ 
and confirmed these results numerically by simulations 
for the case of m = 3. 

For the Ising case, we note that Bray and Moored 
have obtained Eq. for the spin glass susceptibility 
without replicas, starting starting from the local mean- 
field equations of Thouless, Anderson and Palmer— (the 
TAP equations). It would be interesting to see if one 
could derive, along similar lines, a more straightforward, 
and non-replica, calculation of xsg for the vector spin 
case too. 

Although it is not possible experimentally to apply a 
field which is random in direction to a vector spin glass, 
so the AT line seems to be experimentally inaccessible 
(except for the Ising case), one can detect the AT line 
for vector spin glasses in simulations. Whether or not 
at AT line exists in finite-range spin glasses, is a crucial 
difference between the replica symmetry breaking (RSB) 
picture, where it does occur, and the droplet picture, 
where it does not. It has been found possible to simulate 
Heisenberg spin glasses for significantly larger sizes^— 
than Ising spin glasses, so our results may give an addi- 
tional avenue through which to investigate the nature of 
the spin glass state. 
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Appendix A: Fluctuation analysis for Ising spin 
glasses 

We follow AT in obtaining the eigenvalues and eigen- 
vectors (and also the inverse, not calculated by AT) of 
the real symmetric matrix A of dimension 71(71 — l)/2, in 
which each row of column is labeled by a pair of distinct 
spin indices (a/3), with elements given by (see Eq. (|35jl ) 

A-(aP),(r/S) = ( 5( Q/ 3)( 7 5)- 
(0J) 2 {[{S a S?S^S s )] z - [{S a SP)] z [{S-<S 5 )] z } . (Al) 

where the average (• • • ) is over the spins for a fixed value 
of the Gaussian random field z in Eq. (|21[) . and the av- 
erage [• • • ] z is over z according to Eq. ([24)) . 

Because the theory is invariant under permutation of 
the replicas, there are only three distinct values for the 
matrix elements: 

A( a p),(ap) = p - ( A 2a) 
^(q/3),(q7) = Qi (A2b) 
^-(a/3),(7<5) = R, (A2c) 

in which a,j3,j and 6 are all different. Recall that (a/3) 
takes n (n — l)/2 distinct values, i.e. the pair (/3a) is the 
same as the pair (a/3). 

1. First eigenvalue and eigenvector 

If we go along any row or column, the number of times, 
P, Q and R appear is given by 

np = 1, (A3a) 
n Q =2(n-2), (A3b) 
n R = ±(n-2)(n-3). (A3c) 

Since the sum of all elements in any row or column is the 
same for each row and column, it trivially follows that 
there is an eigenvector 

ex = (1,1,... ,1), (A4) 

with eigenvalue equal to the sum of all the elements along 
a row or column, 

Ai = P + 2(n-2)Q + i(n-2)(n-3)P. (A5) 

This eigenvalue has degeneracy 1. 

2. Second eigenvalue and eigenvectors 

We look for an eigenvector e2, e with elements 

e a/3 = ( d (if aor/3 = e), 
2 > e \ e (otherwise), ^ ' 
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for some e. The e 2ie must be orthogonal to e*i in Eq. (|A4I) . 
which means 

E4f=0, (A7) 

(a/3) 

for each e, and so 

(n - 2)e = -2d. (A8) 

Naively the there are n independent vectors since there 
are n choices for e. However, these are not all indepen- 
dent since it is quite easy to show that 

£ e 2 , e = 0. (A9) 

e 

Hence there is one linear constraint among the n vectors 
defined by Eq. (|A6|) and so the number of linearly inde- 
pendent such vectors is n — 1, i.e. the degeneracy is n— 1. 
It is now straightforward to verify from Eqs. (|A6I) and 
(1A"8|) . that 

Ae 2 , e = A 2 e 2 , £ , (A10) 
where A 2 is the eigenvalue, given by 

A 2 = P+ (n-4)Q- (n- 3)R. (All) 
Note that A 2 = Ai for n — > 0. 

3. Third eigenvalue and eigenvectors 

We look for an eigenvector e 3 with elements 

f / (if ("/3) = (W)), 
eg (• ) = < g (if one of (a/3) is equal to one of (rja)), 
AVa> { h (if (a/3) ^ ( W )), 

for some choice of rj and a (with a ^ rj). The vectors in 
Eq. (|A12|) must be orthogonal to e\ in Eq. (IA4|) . and to 
the e 2 , £ in Eq. (|A6|) so 

f = (2-n)g, g=l(3-n)h. (A13) 

One can show that summing over one of the indices 
labeling a vector, gives zero, i.e. 

£e 3 , (t)CT) =0. (A14) 
v 

Equation (|A14[) gives n constraints, one for each value of 
a. Hence the number of linearly independent eigenvectors 
of the third type is n(n — l)/2 (the number of values of 
the index (rjcr)) less n, the number of linear constraints. 
Hence the degeneracy is \n(n — 3). One can also show 
that the sum over one of the replica component indices 
vanishes for each vector—, i.e. 

E4?i)=0- (A15) 



(Recall that the subscript indices (j]<j) indicate a partic- 
ular vector, and the superscript indices (a/3) denote a 
particular element of that vector.) 

It is now straightforward to show that the vectors in 
Eq. (|A12[) are indeed eigenvectors, i.e. 

^63,(770-) = A3e3 !(t?0 .), (A16) 

where A3 is the "replicon" eigenvalue, 

A 3 = P - 2Q + R. (A17) 

The total number of eigenvectors, of type 1, 2 or 3, 
found so far is 1 + (n — 1) + \n(n — 3) = \n(n — 1), which 
is the dimension of the matrix. Hence we have found all 
the eigenvalues and eigenvectors. 

4. Matrix inverse 

Consider the matrix G which is the inverse of A, i.e. 

AG = I (A18) 

where / is the identity matrix. We assume that G has 
the same structure as A and define, see Eq. ([38]), 

G( a p),(a(j) = G%, (A19a) 
G( a p),(cn) = G2, (A19b) 

G(a/3),(7<5) = ^3, (A19c) 

Evaluating the (a/3), (a/3), the (a/3), (0:7), and the 
(aP), (jS) elements of Eq. (|A18|) gives respectively 

PGi + 2(n-2)QG 2 + ±(n-2)(n-3)RG 3 = 1. (A20a) 
Q Gi + [P + (n - 2)Q + (n - 3)R] G 2 + 

[{n - 3)Q + |(n - 3)(n - 4)R] G 3 = 0. (A20b) 
RGi + [4Q + 2(n-4)R]G 2 + 

[P + 2{n - A)Q + i(n - 4)(n - 5)i?] G 3 = 0. (A20c) 
Taking lx(TX20a| -2x|A20b| +lx (|A20c] gives 

(P - 2Q + fl) (Gi - 2G 2 + G 3 ) = 1 , (A21) 
so the "replicon propagator" is given by 

Gr = G 1 -2G 2 + Ga = p _ 2 1 Q + R . (A22) 

The spin glass susceptibility is determined from G T ac- 
cording to Eq. IHP. Note that Eqs. (|MTt and O de- 
termine xsg without needing to diagonalize the matrix 
A. However, since the diagonalization has been done by 
AT it is instructive to see that G r is the inverse of the 
replicon eigenvalue in Eq. ()A17|) . see also Appendix lAl 

If we accept that A3 is an eigenvalue then Eq. (|A22|) is 
obvious since the eigenvectors of A and G are the same, 
and the corresponding eigenvalues are the inverses of each 
other. Furthermore, since the inverse matrix G has the 
same structure as that of the original matrix A, the ex- 
pressions for the eigenvalues of A in terms of the param- 
eters P, Q and R, are the same as the expressions for the 
eigenvalues of G in terms of the corresponding parame- 
ters Gi, G 2 and G 3 . 
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Appendix B: Fluctuation analysis for vector spin 
glasses 

We now have additional indices for the spin compo- 
nents, and to avoid confusion in notation, we will use 
Greek letters a, /3, 7, 5, e for replicas and fi,v, K,a for spin 
indices. A row or column of the matrix will then involve 
4 indices (a0),(ii/, in which the order of the replica pair 
(a/3) is unimportant, i.e. (/3a) is the same as (a/3), but 
the order of the spin indices does matter because S£Sp 
is not the same as S^Sg. 

Another new feature which appears when we deal with 
vector spins is the appearance of terms with both replicas 
equal, (aa). These do not appear for the Ising case be- 
cause (S a ) is equal to 1, a constant. However, (S 1 ^) is 
not a constant for m > 1 and so we now need to include 
(aa) terms in the analysis. 

Hence we shall need to find the eigenvalues and eigen- 
vectors of a matrix Z of size |n(ra+l) m 2 whose elements 
are given by 

Z (a/3),( 7< 5) - () (a^)(7^)C A1 «f , ^- 

(pj) 2 {[(s«ses:s s a )] z ~[(s«s?)] [(£%&)],}. (Bl) 

Ignoring for now the spin indices (which will be put 
back later) we consider the following matrix of dimension 
\n{n + 1) x \n(n + 1), 



7 I A B 

Z - [ B T C 



(B2) 



in which A is the matrix of dimension |n(n— l)x |n(n— 1) 
with rows and columns labeled by two distinct replicas 
(a/3) defined in Eq. (|A2I) , C is an n x n matrix with rows 
and columns labeled by a single replica (aa) , and B is a 
matrix with \n(n — 1) rows and n columns. 



1. Decomposing into subspaces 

We now discuss each of these matrices in turn. 

• The elements of A are given by Eq. (|A2[) . 

• The elements of B are 



B( a p),(aa) — S, 
5(a/9),( 7T ) = T, 

in which a, /3 and 7 arc all different. 
• The elements of C are 

in which a and /3 are different. 



(B3a) 
(B3b) 



(B4a) 
(B4b) 



Now we add the Cartesian spin indices. The result is 
that each element of the matrix Z in Eq. (|B2|) becomes 
an m 2 x m 2 matrix with rows and columns labeled by 
a pair of spin component indices \x and v, each of which 
runs over values from 1 to to. 

A simplification is that the only non-zero elements are 
those where each Cartesian spin component occurs an 
even number of times (combining the row and column 
indices). Hence each m 2 x m 2 matrix breaks up into 
different blocks. There is one m x m block, (p/i, vv) 
where fj, = 1, • • • , n, v = 1, • • • m, and m(m — l)/2 blocks 
of size 2, (hv,ijlv) and (/iv^u/j,) where fj, and v (7^ /x) are 
fixed. 

Consider, for example, one of the elements in A with 
value P, see Eq. (|A2I) . This is now expanded into an 
m 2 x m 2 matrix which is block diagonalized into 

• (i) one m x m matrix, with rows and columns la- 
beled by fifi (/i = 1, • • • , to), 



(Pl Pt 
Pt Pl- 



Pt\ 

P T 



(B5) 



\P T P T ---P L ) 



where the diagonal elements (to which we give the 
subscript L) are different from the off-diagonal el- 
ements (to which we give the subscript T), and 

• (ii) to(to— l)/2 identical matrices of size 2x2, with 
rows and columns labeled by \u> and v/i (for fixed 
\i and v with /j^i/), 



Pi P2 
P2 Pi 



(B6) 



in which we give the subscript "1" to the (equal) 
diagonal elements and the subscript "2" to the off- 
diagonal elements. 

The eigenvalues of (|B5|) are 

P s = Pl + (to - 1)Pt, (degeneracy 1), (B7a) 
Pa = Pl ~ Pt, (degeneracy to — 1), (B7b) 



and those of (IB6I) are 



P+ 



Pi 
Pi 



P2, 
P2, 



(B8a) 
(B8b) 



each of degeneracy 1. 

The R, S, T, U and V elements of the replica matrix, 
in Eqs. (|A2I) . (IB3|) and (|B4I) . expand out into the same 
block structure in spin-component space. 

However, we shall now show that things are somewhat 
different for the Q elements, which have replica structure 
(a/3), (07), i.e. one of the replicas is repeated. The order 
of the replica indices in a pair does not matter but, to 
keep track of which spin index goes with which replica 
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index, we should adopt some convention, e.g. put the 
lower replica index first. Consider then a situation with 
/3 < 7 and different values of a. The Q element involving 
these three replicas would then be labeled differently de- 
pending on the value of a relative to /3 and 7 as follows: 



(a/3), (07) 


(a</3< 7), 


(139a) 


(/3a), (07) 


08 < a < 7), 


1 jjyu 1 


(/3a), (7a) 


08 < 7 < a), 


(B9c) 


Hence the 2x2 matrix Q 


has the form 














Qi Q2 




(BIO) 


V\Ji 


Q2 Qi 






for a < /3 < 7 and /3 < 7 < a, while it is 














Q2 Qi 




(Bll) 




Qi Q2 







for /3<a<7,i.e.Qi and Q2 are interchanged in the 
latter case. This does not affect Q + = Qi + Q2 but it 
changes the sign of Q_ when the repeated replica index 
(a here) lies in between the other two (/3 and 7 here). 

Our goal is to diagonalize the matrix Z given by 
Eq. (|B2|) . in which A, B and C, are matrices in replica 
space given by Eqs. (|A"2|) . (|B3t and ([B4|). and each el- 



ement in these matrices is itself an m x m replica in 
spin-component space which block diagonalizes as dis- 
cussed above. Symbolically we want to find the eigenval- 
ues A and eigenvectors (e, /) of 



A B\ e 
B T C) ( / 



A 



(B12) 



• m(m — l)/2 identical sets of equations of the type 

A: ( r \ ■ (B15) 



A+ B, 
Bl C 4 



• and 777(777 — l)/2 identical sets of equations of the 
type 



A_ B\ e- 



A_ 



(B16) 



The matrices in Eqs. (|B13[) - (|B16[) are of dimension n(n+ 
l)/2, while the vectors e are of length n(n — 1)/2 and the 
vectors / are of length n. 

Each of the sets of equations, (|B13I) - (|B16I) has the 
same structure, which is a little more complicated than 
diagonalizing the matrix A, described in the first part of 
this report, because the off-diagonal piece B couples the 
elements of A to the nx n block C, in which each row or 
column index has two equal replicas. However, we shall 
see that the square blocks A and C decouple in two cases: 
(i) the "— " sector, and (ii) the replicon eigenvectors in 
the S, A, and "+" sectors. 

We shall first discuss the S, A and "+" spin-component 
sectors together, and then do the "— " sector which has 
to be treated separately. 

2. The S, A and "+" Spin-Component Sectors 

The matrices for these sectors are all the same pro- 
vided one replaces the elements of the replica matrix Z 
in Eq. (|F32|) by the appropriate eigenvalue of the spin- 
component sector, see Eqs. (|B7j) - (IB8|) for the case of P. 

We first discuss the replicon subspace. 



a. Replicon Modes 



where the vector e is of dimension \n(n — l)m 2 and / is 
of dimension nm 2 . 

Because the block structure in spin-component space is 
the same for all elements of Z in Eq. (|B2[) (except for the 
some aspects of the "— " sector),, we can diagonalize sepa- 
rately the spin-component and replica sectors. Hence the 
eigenvalue equation, Eq. (|B12I) , breaks up into 4 simpler 
sets equations, one set for each distinct spin-component 
sector: 



1 set of equations of the type 



As B s \ (e s 

fs 



B T S C, 



= Ac 



(B13) 



to — 1 identical sets of equations of the type 



A A B a 

T 
A 



B\ C A 



e r) = x 4 e r 

J A) \JA 



(B14) 



Let us see if the replicon eigenvector, computed for the 
Ising case in Sec. IA 31 satisfies Eq. (|B2j) with / = 0, i.e. 



A B\ fe 3 \ _ fe 3 

b t c [0 J -M 



^2 - B ("/3)^77) e 3^ ) - °> 
(a/3) 



which requires 



for each 7. From Eq. (|T33|) we have 



J2B ia ^ ) e^ = 2Sj2e^+T £ 



(B17) 



(B18) 



>/3) 
-3 



(a/3) 



(B19) 

The first term vanishes because of Eq. (|A15|) . Again us- 
Eq. (|AT5| . the sum in the second term can be writ- 
ten as — X)/3^7 e 3 7/3 '' which again vanishes by Eq. (|A15|) . 
Hence Eq. (|B18[) is satisfied. 



13 



As a result, we don't need to do any more work to get 
the eigenvalues in the replicon sector for the vector spin 
glass. We just use Eq. (|A17[) for each of the S, A and 
"+" spin-component sectors in Eqs. (|B13|) ~ (|B15|) . i.e. 

A 3S =P S - 2Q S + Rs 

= [P L + (m - 1)P T ] - 2[Q L + (m - 1)Qt} + 

[Rl + (m- 1)R t ], (B20a) 
X 3A = Pa- 2Q a + R A 

= (Pl - Pt) - 2(Q L - Qt),+(Rl - Rt) (B20b) 
A 3+ = P+ - 2Q+ + R+ 

= (Pi + P 2 ) - 2(Qi + Q 2 ) + (Ri + R 2 ). (B20c) 

As discussed above, the spin-component degeneracies of 
the S, A, and "+" subspaces are 1, (m — 1), and ^m(m — 
1) respectively. To get the overall degeneracies of the 
eigenvalues in Eq. (|B20[) one has to multiply these factors 
by the degeneracy in replica space, \n(n — 3). 



b. "Ai " Modes 



"A 2 " Modes 



We follow the procedure of Sec. IA 21 by looking for an 
eigenvector in which one replica, e say, is distinct from 
the others. Referring to Eq. (|B14[) . we set equal 
to d if a or j3 are equal to e, and equal to e otherwise. 
Orthogonality to the Ai eigenvector requires (n — 2)e = 
—2d, see Eq. (|A8p . Similarly we set fg 2 equal to / if 
a = e and equal to g otherwise. Orthogonality to the Ai 
eigenvector requires (n — l)g = — f. 

Substituting into Eq. (|B14[) then gives the coupled 
equations 



«2S P2s\ ( d 
(n - 2)j3 2 s 12S J \g 



= A 



is 



(B24) 



where 

012S 

P2S 
725 



[P L + (m - 1)Pt] + (n - A)[Q L + (to - 1)Q T ] 

- (n - 3) [R L + (m-l)R T ], (B25a) 
[S L + (to - 1)S T ] - [T L + (to - l)T T ], (B25b) 
[U L + (to - 1)U T ] - [V L + (to - l)V T ]. (B25c) 



Referring to Eq. (|B13[) we look for a solution where 
all the elements of e$i are equal to a, say and all the 
elements of fsi are equal to b. This gives the coupled 
equations 



otis 



^ (t) ^ A, 



\(n-l)p ls us \b 



(B21) 



where 



ais = [Pl + (to - 1)P t ] + 2(n - 2)[Q L + (m - 1)Q T ]+ 
±(n-2)(n-3)[R L + (m-l)R T ], (B22a) 
Pis = 2[S L + (m - 1)S T ] + (n - 2)[T L + (m - 1)T T ], 

(B22b) 

lis = Wl + (to - l)U T ] + (n- l)[V L + (to - 1)F T ]. 

(B22c) 

The eigenvalues are given by the solutions of the resulting 
quadratic equation 



1 



Ala,S — 7^ 



Ai 6 ,s - ^ 



ais + 7is + \J (ais ~ lis) 2 + 2(n - 1)01 

(B23a) 

+ lis-\j (ais - lis) 2 + 2(n - 1)0* 3 . 

(B23b) 



The eigenvalues are given by the solutions of the re- 
sulting quadratic equation 



A 



2a, S 



^2b,S 



«2S + 72S 



«2S + 72S 



\J (&2S 



12S 



) 2 +4(n-2)/3, 2 



2S ' 

(B26a) 



\J («2S 



72S 



I 2 +4(n- 2)/3, 2 



2S ■ 

(B26b) 



Analogous results are obtained for the A and "+" sub- 
spaces. The spin-component degeneracies for the 5, A 
and "+" subspaces are 1, m — 1 and m(m — l)/2 respec- 
tively. These have to be multiplied by the degeneracy 
from the replica sector which is n — 1 . 



3. The "-" Spin-Component Sector 



The spin-component degeneracy for these eigenvalues 
is |m(m — 1). 

The blocks with (a/3) ((3 ^ a) and (aa) decouple. The 
reason is that 2 ^ <Si = S2 and T\ = T2 which follows from 
the symmetry properties of the expression for the matrix 
elements in Eq. (IF31|) and the definitions in Eqs. (|F33|) and 
(|B6|) . It then follows from Eq. {BgJ that S- = T- = 
and so, from Eq. (|B3[) . the matrix vanishes. 



This calculation simply repeats for the A and "+" sec- 
tors with the appropriate substitutions for a, j3 and 7. 
The spin-component degeneracies for the 5, A and "+" 
sectors are 1, m — 1 and m(m— l)/2 respectively. These 
have to be multiplied by the degeneracy from the replica 
sector, which is just 1 in this case. 



a. The (aa) Subspace 

We can easily obtain the "— " eigenvalue which lies 
entirely within the (aa) subspace, since 2 ^ Vi = V 2 , so 
V- = and hence C_ is a diagonal n x n matrix with 
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the constant value U- = U\ — Ui on the diagonal. Hence 
there is an eigenvalue 

Xi- =U- = U 1 -U 2 , (B27) 

with total degeneracy |nm(m — 1). It has no analogue 
in the other spin-component sectors. 

b. The (a/3) Subspace, (a / /?) 

Now we consider the "— " eigenvalues which lie entirely 
within the (a/3) (/? ^ a) subspace of dimension n(n — 
l)/2. We find that there are two distinct eigenvalues (for 
general n). 

We ask if there are eigenvalues analogous to Ai, A2, A3 
that we found in Appendix [S] for the Ising case. The 
eigenvector corresponding to Ai for the Ising case has 
all components equal, since the sum along all rows and 
columns of the matrix is the same. However, this is not 
the case here because the number of times — Q occurs is 
therefore different for different rows or columns. Hence 
there is no eigenvalue analogous to Ai. 

Each of the n — 1 eigenvectors for A2 for the Ising case 
singled out a particular replica. For example, picking out 
out replica e, the coefficients of (i) (ea), and (ii) (aft) in 
which neither a nor (3 equal to e, would be different, see 
Eq. (|A8[) . There is a similar eigenvector here in which 
the type (ii) components vanish and the type (i) compo- 
nents are no longer all equal but have value —1 for a less 
than the special replica (e in our example), and +1 for a 
greater than the special replica. By inspection this has 
eigenvalue 

A 2 _ = P + (n - 2)Q . (B28) 

There are n ways to pick the special replica, but the 
resulting n eigenvectors sum to zero since, in the sum, 
each element appears twice, once with a plus sign and 
once with a minus sign. In other words, there is one 
linear relation between the eigenvectors, so the replica 
degeneracy of A2 is actually n — 1 rather than n. 

For the Ising case, each of the eigenvectors for A3 picked 
out 2 replicas. For example, picking out replicas a and 
/3, the coefficients of (i) (a(3), (ii) (aj) and (f3j), and (hi) 
(7<5) (all replicas with a different label assumed different) 
would be different, see Eq. (IA13[) . There are eigenvectors 
like this here, in which type (iii) components are zero, 
type (ii) components (0:7) have value 1 if 7 < a < /3 
and —1 otherwise, and the type (i) component has value 
n — 2. For example, for n — 4 there are 6 such vectors 
(not all independent, see below) which are 



e ( i2) = 


(2,-1,-1,1,1,0), 


e ( i 3 ) = 


(-1,2,-1,-1,0,1), 


e ( i4) = 


(-1,-1,2,0,-1,-1) 


e (2 3) = 


(1,-1,0,2,-1,1), 


£(24) = 


(1,0,-1,-1,2,-1), 


£(34) = 


(0,1,-1,1,-1,2). 



By inspection these have eigenvalue 

A 3 _ = P - 2Q . (B30) 

One can also see from the above vectors, which are for 
n = 4, that £(14) can be expressed as a linear combination 
of the e(x a ) for a < 4, and similarly £(24) can be expressed 
as a linear combination of the e/ 2a ) for a < 4, and the 
same for e/34). Hence the last replica can be eliminated, 
so the number of linearly independent vectors, which is 
the replica degeneracy of A3_, is i(n — l)(n — 2). 

Hence, including both A2- and A 3 _, we have found 
all \n(n — 1) eigenvalues and eigenvectors in the replica 
sector. 

4. Summary of Eigenvalues 



The eigenvalues, along with their degeneracies, are 
summarized in Table IIII1 in which the a's, j3's and 7's 
are defined by 



Otis — 


L Ju 


- (m — 


1)P T ] 


+ 2(n- 


- 2)[Ql 


+ (m- 


- 1)Qt] 






4 


-\{n- 


■2)(n- 


-3)[i? L 


4- (m — 


l)i?T], 

(B31a) 


PlS = 




+- (m - 


-1)S T 


| + (n- 


"2)[Ti 


+ (m — 


l)Tr], 


lis = 




- (m — 


1)Ut] 


+ (n- 


1)[Vl4 


- (m — ; 


L)VH 
(B31c) 


OtlA = 


(Pl - 


-P T )+2(n- 


- 2)(Qr 


- Qt) 










^ 


-i(n- 


- 2)(n- 


- 3)(i? L 


- R T ), 


(B31d) 


0TA = 






+ (n - 


-2)(T L 






(B31e) 


llA = 


{Ul- 


-U t )- 


f (n ~ 


l)(Vb- 


-V T ), 




(B31f) 


Ol+ = 


= (PiH 


-P 2 )H 


-2(n- 


-2)(Qx 


+ Q2) 














-2)(n- 


-3)(iJi 


4-i? 2 ), 


(B31g) 


/?!+ = 


= 2(5i 


+ s 2 ) 


+ (n- 


-2)(Tx- 


f T a ), 




(B31h) 


7i+ = 


■{Ui- 


\-u 2 )- 


\-(n- 


l)(Vi 4 


-Va), 




(B31i) 


Ot2S = 


[Pl^ 


- (m — 


1)P T ] 


+ (n- 


4)[Ql 


+■ (m- 


1)Qt] 








-(n- 


-3)[R L 


+ (m - 


- 1)Rt]- 


, (B31j) 


/?2S = 




- (m — 


l)S T ] 


-[Tl- 


- (m — 


1)Tt], 


(B31k) 


12S = 




- (m — 


1)Ut] 


-\v L - 


f (m — 


1)Vt], 


(B311) 


O2A = 


-{Pl 


-Pt) 


+ (n- 


■4)(Ql 
— (n — 


-Qt) 
3)(i?L - 


-iJr), 


(B31m) 


/?2A = 


--(Sl- 


-S t ) 


-(Tl 


-2V), 






(B31n) 


12A = 


-(U L 


-U t ) 


-(Vl 


-V T ), 






(B31o) 


012+ : 


= (Pi 


+ P2) 


+ (n- 


■4)(Qx 
— (n — 


+ Q2) 
3)(Ri - 


+■ «a), 


(B31p) 




= (Si 


+ S 2 ) 


-(Ti- 


f T a ), 






(B31q) 


12+ ■- 


= (Ui 


+ u 2 ) 


- (Vi + v 2 ). 






(B31r) 
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Eigenvalue 


replica degeneracy 


spin-component degeneracy 


^la, S 


1 
2 


AM c -t- 'Vi -4- \ /(rVi c — 'Vt ) ^ _i_ (77 — 1 ^ 
u lo flo T y \ -L^ f-L^J / ^ ^yit Jl IS 




1 


1 


^lb,S 


1 

2 


rVl O -I- "VlC A I (n/1 O "/I 1 /+, — 1 ^ /?"^ 




1 

_l 


1 
± 




1 
2 


<-*2S \ J2S 1 V 1*^25 /2S ^ T ^)I->2S 




n 1 


1 
1 




1 

2 


f\net — 1— d , / ( f\n ■: 'Vo c *\ -i- A( Ti C )\ ffi' 

<-X2S \ J2S V ^26 /26 J ^J^2S 




17 1 
lb 1 


1 
1 




[Pl + (m 


- 1)Pt] - 2[Q L + (m- 1)Qt] + [Rl + (m - 


- DRt] 


— 3) 

2 v / 


1 


Ala, A 


1 

2 


aiA + Jia + \/ (aiA - Jia) 2 + 2(n - l)fi 2 A 




1 


m — 1 




1 

2 


aiA + 71A - \J (aiA - 7ia) 2 + 2(n — 1)0( A 




1 

_L 


772 — 1 


A2a A 


1 

2 


Ct2A + 72A + y/ (a2A - J2a) 2 + 4(n - 2)/3 2 A 




n — 1 


7YI — 1 


^2b, A 


1 

2 


Q-2A + 72A - \/ ( a 2A - 72a) 2 + 4(n - 2)p£ A 




n — 1 


772 — 1 


A3A 




' (Pl - Pt) - 2(Q L - Q T ) + {Rl - Rr) 


|n(n — 3) 


m — 1 


Ala + 


1 

2 


ai+ + 7i+ + yj (ai+ - 7i+) 2 + 2(n - l)/3 2 + 




1 


^m(m — 1) 


Alb,+ 


1 

2 


«i+ + 7i+ - \J ("i+ ~ 7i+) 2 + 2(n - l)/3 2 + 




1 


— 771 ^ T77 1 ^ 


A2a,+ 


1 

2 


«2+ + 72+ + ^ (a 2 + - 72+ ) 2 + 4(?i - 2)/3 2 + 




n - 1 


^m(m — 1) 


A26,+ 


1 

2 


Q2- + 72- + J{ot2- - 72- ) 2 + 4(n - 2)/3 2 _ 




n - 1 


im(m — 1) 

2 v / 


A3+ 




(Pi + P2) - 2(Qi + Q 2 ) + (Pi + P 2 ) 


in(n — 3) 


im(m — 1) 


A 2 - 




(Pi -P 2 ) + (n-2)(Qi -Q 2 ) 


n - 1 


^m(m — 1) 


A 3 - 




(Pi - P2) - 2(Qi - Q 2 ) 


|(n-l)(n-2) 


^m(m — 1) 


A 4 - 




C/i -t/ 2 


n 


im(m — 1) 



TABLE III: Eigenvalues and degeneracies for the m-component model. The total degeneracy for each eigenvalue is the product 
of the replica degeneracy and the spin-component degeneracy. It is easy to see that the total degeneracy is \n(n + 1) x m 2 , as 
required. 



By symmetry 22 , R, = R 2 , S x = S 2 , T x = T 2 , V x = V 2 . 

There are 18 distinct eigenvalues for arbitrary n. In the 
limit n ->• 0, a is = a 2 s, Pis = fos, lis = 725, ol 1a = 

&\A = 02 A, JlA = 12A, «1+ = "2+ , Pl+ = @2+, 

7i+ = 72+, so Ai a , 5 = A 2a ,s, etc., and also A 2 - = A 3 _. 
Hence there are only 11 distinct eigenvalues in the n — > 
limit. 

Most of the results in Table IIIII agree with those in 
de Almeida's thesis^. However, there are some differ- 
ences, the most notable of which is that the eigenvalue 
A3S , which gives the divergence of the non-linear suscep- 
tibility according to Eq. (|BU1) , does not appear in Ref . |22| . 
However, we are confident that this eigenvalue is correct 
and that its change of sign gives the AT instability. We 
note, for example, that the combination of propagators 
on the LHS of Eq. (IB35I) corresponds precisely to that in 
Eq. (3.5) of Ref. |2l 

In the Ising (m — 1) limit only the "<S"' eigenvalues sur- 
vive (the degeneracy of the rest is zero), and we present 
these results in Table [TVl One has^ 2 - S L = T L = 0, so 
Pis = 0, and Ul = 1, Vl = 0, so 715 = 1. Hence the first 
four eigenvalues are ais,l,a2S and 1. The two eigen- 
values that are equal to 1 involve fluctuations of the q aa 
which couple to (S a ) 2 , a constant, (so there is no actual 
coupling to the spins). Hence these eigenvalues are triv- 
ial. The remaining three eigenvalues are just those of the 
original AT paper—, see Table ITVl 



Eigenvalue 


degeneracy 


Ala 


Pl + 2(n - 2)Q L + |(n - 2)(n - 3)P L 


1 


Aii, 


1 


1 


A2a 


Pl + (n - 4)Q L - (n - 3)R L 


n - 1 


A26 


1 


n - 1 


A3 


Pl - 2Q L + Rl 


\n(n - 3) 



TABLE IV: Eigenvalues and degeneracies for the Ising case, 
m — 1. 



5. Matrix inverse for vector case 



As for the Ising case, we assume that G, the matrix 
inverse of Z, has the same structure as Z itself. In par- 
ticular, we define 





= Gil, 


U (a/3),(a/3) 


= Git 






(B32a) 


U (a/3) : (a 7 ) 


= G 2 l, 


LT (a/3),(a 7 ) 


= G2T 






(B32b) 




= G 3 L, 


(j (a/3),( 7 ,5) 


= G3T 






(B32c) 




= G4L, 


Lt (q/3),(qq) 


= GiT 




y\ 


(B32d) 


(a/3), (77) 


= G 5 L, 


(a/3), (77) 


— G5T 




v), 


(B32e) 



where a, /3, 7 and S are all different. Considering various 
matrix elements of both sides of ZG — I we get 
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PlGil + (to - l)P T G XT + 2(n - 2)(Q L G 2L + (m - 1)Q t G 2 t) + \{n- 2)(n - 3)(P L G 3L + (m - l)i? T G 3T )+ 

2(S L G 4L + (to - 1)S T G 4T ) + (n - 2)(T L G 5L + (to - 1)T t G 5 t) = 1 (B33a) 

PlGit + PtGil + (to - 2)P t Git + 2(n - 2)(Q L G 2T + QtG 2L + (m - 2)Q T G 2T ) + 

|(n - 2)(n - 3)(P L G 3T + PtG 3 l + (to - 2)i? T G 3T ) + 
2(S L G 4T + S T G 4L + (to - 2)S T G 4T ) + (n - 2){T L G 5T + T T G 5L + (to - 2)T T G 5T ) = (B33b) 

QlGil + (to - l)Q T G 1T + (Pi + (n - 2)Q L + ( n - 3)Pl)G 2L + (to - 1)(P T + (n - 2)Q T + (n - 3)P T )G 2T + 
((n - 3)Q L + |(n - 3)(n - i)R L )G 3L + (to - l)((n - 3)Q T + \{n- 3)(n - 4)P T )G 3T + 

2(S L G 4L + (to - 1)S T G 4T ) + (n - 2)(T L G 5L + (to - 1)T T G 5T ) - (B33c) 

QlGit + QtGil + (to - 2)Q t Git + (Pi + (n - 2)Q L + (n - 3)P L )G 2T + (Pr + (n - 2)Q T + (n - 3)P T )G 2L + 
(to - 2)(P T + (n - 2)Q T + (n - 3)i? T )G 2T + ((n - 3)Q L + ±(n - 3)(n - 4)i? L )G 3T + 
((n - 3)Q T + |(n - 3)(n - 4)P T )G 3L + (to - 2)((n - 3)Q T + \{n- 3)(n - 4)P T )G 3T + 

2(5 L G 4T + 5tG 4L + (to - 2)S T G 4T ) + (n - 2)(T L G 5T + r T G 5L + (to - 2)T T G 5T ) = (B33d) 

PlGil + (to - 1)R T G 1T + (4Q L + 2(n - 4)P L )G 2L + (to - 1)(4Q T + 2(n - 4)P T )G 2T + 

(Pz, + 2(n - 4)g L + §(n - 4)(n - 5)P L )G 3L + (to - 1)(P T + 2(n - 4)Q T + §(n - 4)(n - 5)P T )G 3T + 

2(5 L G 4L + (to - l)S T G iT ) + (n - 2)(T L G aL + (to - 1)T T G 5T ) = (B33e) 

P L GiT+PTGi L + (TO-2)P T GiT+(4QL+2(n-4)P L )G 2 T + (4gT+2(n-4)P T )G 2L + (TO-2)(4Q T +2(n-4)P T )G 2T + 

(Pi + 2(n - 4)Q L + i(n - 4)(n - 5)P L )G 3T + 
(Pr + 2(n - 4)Q T + |(n - 4)(n - 5)R T )G 3L + (to - 2)(P T + 2(n - 4)Q T + |(n - 4)(n - 5)P T )G 3T + 

2(SiG 4T + StG&l + (m - 2)S T G 4T ) + (n - 2)(T L G 5T + T T G 5L + (to - 2)T t G 5 t) = (B33f) 

Forming appropriate linear combinations of Eqs. (IB33I) gives 

([Gil + (to - l)Gi T ] - 2[G 2L + (to - 1)G 2T ] + [G 3L + (to - 1)G 3T ]) x 

([P L + (to - 1)P T ] - 2[Q L + (to - 1)Q T ] + [R L + (to - l)i? T ]) = 1. (B34) 

so the "replicon" propagator is given by 

G r = [Gil + (to - 1)G 1T ] - 2[G 2L + (to - 1)G 2T ] + [G 3L + (to - 1)G 3T ] 

= ([Pl + (to-1)P t ]-2[Q l + (to-1)Q t ] + [P l + (to-1)P t ]) \ (B35) 

I 



Appendix C: Averages over spin directions 

To evaluate the spin glass susceptibility we need to 
compute averages over spin directions. Consider, for ex- 
ample, 

Z= f dO m exp[H-e], (CI) 



where the integral is over the surface, f2 m , of a sphere of 
unit radius, e is a unit vector whose direction is to be 
integrated over, and H is a fixed vector. 

Working in polar coordinates, with the polar axis 
along the direction of the fixed vector H, the inte- 
gral in Eq. (jCl[> can be expressed entirely in terms of 
the polar angle 9, since exp [H ■ e] = cxp[Hcos9] and 
/ d£l m = C m J? sin m_2 9 for a constant C m . To deter- 
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mine C m we note the following result o 35 ' 36 , 

27r m/2 



sin" 1 " 2 6d6 = Ttt 

r 



r(s^i) 



(C2) 
(C3) 



where T is the usual Gamma function, which gives 

27r (m-l)/2 



r(^) 



Hence Z can be written as 

27r (m-l)/2 



exp [H cos 0] sin'"- 2 d6 . (C5) 



The integral is given in terms of a modified Bessel 
function^, and we have 



Z = 



, , m/2 I rn/2-l(H) 



(C6) 



Of greater interest are averages of the spins. Consider 
first 



{S,)=m 1 ' 2 {e,), 



,1/2 



1 dZ 



m 



1/2 



Z &H>' 
1 5Z 

z ~h" aff' 



Using 35 



we get 



_d_ 

dx 



m/2-l 



i/2-l 



j.m/2 — 1 : 



(5^) = to 



We shall also need 



1/2 ^m/2( g ) 



I m /2-l(H) 



\H» d (H v dZ 
m 



(CIO) 



(Cll) 



(C12) 



I m /2-i(H) 



I m/2 {H) H»H V 
v ^ r ^ 2 im/2+l^-nJ 



in which we again used Eq. (jClOp . 

To apply these results, we note that, in the presence of 
a external random field, the replica symmetric solution 
predicts that H is given by 



H = /3m 1 / 2 (J 2 q + h 2 r ) z. 



(C14) 



where each component of the variable z is a Gaussian 
random variable with zero mean and standard devia- 
tion unity. To see this, compare Eq. ([55)) with Eq. (IC1[) 



and note that the spins are of length to 1 / 2 according to 
Eq. @. Hence each component of H has zero mean and 
standard deviation given by 

A = /3m 1 / 2 (J 2 q + h 2 r ) 1/2 . (C15) 

As for the Ising case, we denote averages over H, or 
equivalently over z (H and z are related by Eq. (|C14|) ). 
by [• • • ] z and so, for example, in situations which only 
involve the magnitude of H, we have 



a 



dH„ 



(27r) m /2A' 

ol-m/2 



(2tt) 1 /2A 



H' 



H 2 

exp 



A m r i 



ol-fn/2 



H m ~ l exp 



2A 2 
H 2 



2A 



.... . e -z /^f^Az)dz, 



v m — l 



f(H) dH, 

/•:// ?'///• 
(C16) 

(C17) 



where we used the result for Sl m in Eq. (|C2[) . and A is 
given by Eq. (|C15j) . 

Using these results we now calculate the spin glass or- 
der parameter q, which is given by 



(C7) 


1 


(C8) 


q = — 

to 


(C9) 


m 

= E 



Im/2(H) 
Im/2-l(H) 



i/2 



i(H)J 



L m/2- 
2l-m/2 

AT (f) 7 

2l— m/2 coo 



m — 1 



exp 

Z 2 /2 



H 2 
2A 2 

I m / 2 (Az 



I m /2(H) 

I m /2-l(H) 
2 



r(f) y ~~~ ' V^/2-i( A ^), 

(C18) 

where we used E q. (ICTTj) . Equation ([CTS]) . with 
A given by Eq. (|C15[) . is the self-consistent equa- 
tion which determines q. As an example, for to = 
1) Im/2{H) I I m /2-x{H) — tanh(if) = tanh(Az), and we 
recover the result for q in Eq. (l29l) . For general m, ex- 



(C13) panding the Bessel functions for small argument, we 



get 

q 



r l 



:H 2 



to 3 (to + 2) 
5m + 12 



fi 4 + 



-H 6 + 0(H 3 ) (C19) 
m 4 (m + 2y{m + 4) Jz 

If we do the Gaussian integrals, set h r = 0, and solve for 
q, we find 

1 



t + 



t 2 + 0{t A ), (h r =0), 



(C20) 
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where t, the reduced temperature, is given by t — (T c — 
T)/T c , and the zero field transition temperature is T c — 
J, see Eq. ©. 

Our main goal is to compute the eigenvalue X^s since 
this determines the spin glass susceptibility, the diver- 
gence of which indicates the location of the AT line. From 
Eqs. (|B20a|) . (|A"2)l , (|B5|) , (jBT]) and (|B2]), we find the fairly 
simple expression 



Ass = 1 - (/?J) 2 - E 



[(^^) 2 - 2(S I1 S V ){S I1 ){S„) + (S (1 ) 2 (S u ) 2 ] z , (C21) 



which is instructive to write in the following form 

A35 = 1 — iPJ) 2 Xsgi (C22) 
where is a single-site spin glass susceptibility, 



1 E 

711 * J 



(C23) 



Evaluating the spin averages in Eq. (|C23|) using 
Eqs. (|CTT1l and (ICT3t gives 



Xsg = m 



J2 777T { Jp I ni/2( H ) + T[ I ™/2{H)I m /2+i(H) + I 2 n/2+ i{H) 

rail — IV / I 



I 3 



/2- 



{^W 2 W + I 2 m/2 (H)I m/2+1 (H) 



Im/2(H) \ 4 
I m /2-l{H) J 



(C24) 



We recall that the average over if is evaluated according 
to Eq. (|C16J) . For the Ising case, m = 1, Eq. (|C24j) 
simplifies to 



Xsg 



[1-2 tanh 2 i? + tanh 4 H) z 



(C25) 



in agreement with Eq. (|45|) . For the Heisenberg case, 
to = 3, Eq. (|C24|) becomes 



Xsg = 3 



3 + 2H 2 - AH coth(i? ) 
^4 



1 



sinli (iJ) 



, (C26) 



which, together with Eqs. (IC16|) and (|C22I) . gives A35. 
Equations (|C24|) and (IC26P appear to be a new results. 
Expanding the Bessel functions for small H gives 



Xsg 



1 



5m + 16 4 
to 3 (to + 2) 2 



0(# 6 ) 



(C27) 

Let us evaluate g and A35 near T = T c (= J), the 
zero field transition temperature, and for small /i r . Using 
Eqs. (IC19|) and (|C27|) . and doing the Gaussian integrals, 
we find 



A - 2A 4 



A 3S = 1 - (PJf 



bra + 12 ~ 6 



to + 2 
1 - 2A 



■ A 



2 , 5m + 16 ~ 4 



where 



A 2 
rn 



/3 2 (J 2 q + h 2 r ). 



(C28) 



(C29) 



(C30) 



Combining Eqs. (|C29| and (|C28| . and assuming 

h r <t= (T c - T)/T c < 1 , (C31) 

which will be valid at and below the AT line near T c , we 
get 



A 



3S 



h r \ 1 4 



J / 9 TO + 2 



(C32) 



In the limits of Eq. (|C31I) . we have q = t + 0(t 2 ), see 
Eqs. (|C20| and (|cfe|) . and so 

* = ("-«"• ( C33 » 



which changes sign for 
1 



m + 2 



(C34) 



Equation (|C34|) gives the location of the AT line for an m- 
component spin glass near the zero field transition. The 
replica symmetric solution is unstable at lower temper- 
atures and fields since X^s < in that region according 
to Eq. (|C33| . Note that Eq, (|C34|) correctly gives the 
AT result that h 2 = (4/3) t 3 for to = 1 (This is a valid 
comparison even though AT used a uniform field since, to 
lowest order in t, the location of the AT line in the Ising 
case is the same£ for random and uniform fields.) On the 
AT line we find that the spin glass order parameter is 
given by 



t + 



t 2 + 0(t 3 ), (on AT line). 



(C35) 
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In the opposite limit, T — > 0, we find, using properties 
of the Bessel functions, that 



we get 



h r (T = 0) 



1 



(m > 2) . 



(C36) 



J Vm-2 
while h r (T —> 0) diverges for to < 2. For the Ising case, 



h -^ = Jli (m-l), (C37) 
J V 9vr I 



in agreement with Bray 7 . 
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